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Abstract 

The purpose of this paper is to examine the characteristics of Albanian secondary schools, which are associated 
with reading achievement and the effects of gender and socio-economic status on reading performance of 
15-year-old students. This study used data on the background and achievement of 4,596 students in 181 Albanian 
schools from the 2009 Programme for International Student Assessment (PISA). Given the nested structure of 
the data, two-level Hierarchical Linear Modeling (HLM) methods were used to address multilevel research 
questions. About a third of the total variance in reading performance lies between schools, indicating that school 
characteristics are important in predicting student achievement. The results clearly reveal the significant 
relationships of socio-economic status (SES) and gender with student achievement, even after controlling for 
family structure (two parent families versus others), learning strategies use, and reading engagement. There is 
also a substantial variability among schools on gender difference in student performance and the effect of SES 
on student performance. The results from the between-school model suggest that school type, school SES and 
classroom environment are significant predictors of school performance. Moreover, gender gap in reading 
performance is associated with school sector (public/private), school location (urban/rural), and average reading 
engagement; and SES effect on student performance is associated with school type (general/vocational), school 
location and average reading engagement. The characteristics of schools that make them excellent and more 
equitable are summarized. 

Keywords: gender, hierarchical linear modeling, PISA, reading performance, socio-economic status 

1. Introduction 

During the past decade, education reform in Albania has focused on improving student learning outcomes and 
equality of educational outcomes and opportunities. Raising achievement levels for all students (excellence) 
while narrowing the gaps between groups (equity), was one of the specific objectives for the Educational 
Excellence and Equity project started in 2006 (World Bank, 2006). Evidence from the Programme for 
International Student Assessment (PISA) has revealed low achievement levels of Albanian schools and stark 
inequalities in educational achievements. Therefore, it is of great interest for researchers to investigate questions 
and provide insight on the quality and equity of education in Albania. More specifically, identifying factors 
associated with achievement levels and achievement gaps has been of increasing need among educators and 
policy makers recently in Albania. 

Considerable research has recently accumulated on the effects of school characteristics on academic achievement. 
Previous research on school effects has produced contradictory results. In one of the most cited works, Coleman 
et al. (1966) found that school effects on student achievement existed but were less important than student 
backgrounds. Later, Hanushek (1997) supported Coleman findings claiming that no strong or consistent 
relationship exists between school inputs and student performance. However, according to Gamoran and Long 
(2007), a number of sociologists have suggested that Coleman’s findings had several problems. By contrast, 
many other studies have revealed that school characteristics make a significant difference in student achievement 
(e.g., Fuller & Clarke, 1994; Greenwald, Hedges & Laine, 2006; Lee, 2000; Willms & Somers, 2001). In 
particular, the importance of school structure variables, such as location and sector (e.g., Lubienski, 2006; 
Organisation for Economic Co-operation and Development [OECD], 2010a), school composition variables, such 
as school socioeconomic status (SES) (e.g., Caldas & Bankston, 1997; Ewijk & Sleegers, 2010; Ho & Willms, 
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1996; Konstantopoulos, 2006; Lee & Bryk, 1989), school environment (e.g., Ma & Klinger, 2000; OECD, 
2010b), and school resources (e.g., Rutter & Maughan, 2002), has been demonstrated in previous research. 
These variables are also likely to relate to student achievement, because PISA 2009 results indicate that the 
average achievement in reading varies considerably across schools in Albania (OECD, 2010b). However, school 
effects on student performance may decrease or disappear once peer and individual effects are considered. For 
example, S. Lubienski and C. Lubienski (2005) argued that although student performance was greater in private 
schools, student performance was greater in public schools whether students are in the same socioeconomic class. 
Consequently, previous research suggests that the effects of the most important school variables vary across 
studies and countries. 

A common finding across numerous studies has been that students’ SES and academic achievement are 
positively related (see Sirin, 2005; White, 1982). Despite a variety of SES constructs and different 
SES-achievement correlations in literature, it is highly likely that SES is an important predictor of student 
achievement. In this study, SES refers to a combination of characteristics that describe social, economic, and 
cultural status of a student’s family (OECD, 2010a). PISA 2009 study affirmed that, on average, students with 
more socio-economically advantaged backgrounds perform better (OECD, 2010a). Moreover, several 
researchers have attempted to identify features of schools where the relationship between SES and student 
achievement is stronger or weaker (see Caldas & Bankston, 1997; C. Howley & A. Howley, 2004; Lee, 2000; 
Lee & Bryk, 1989; Lee, Croninger, & Smith, 1997; Willms, 2003; Zhao, Valcke, Desoete, & Verhaeghe, 2012). 
However, no previous research in Albania has explored school-level characteristics associated with achievement 
gaps by SES. 

Gender achievement gaps have widely been reported in literature. Considerable evidence from previous research 
suggests that, on average, girls outperform boys in reading achievement. According to PISA 2009, out of 75 
participating countries, Albania displays the largest gender achievement gap in reading favoring girls. Therefore, 
understanding gender differences in academic achievement has become an important educational policy issue in 
Albania. Recently, researchers have sought to identify not only biological and socio-psychological reasons, but 
also school characteristics with links to gender gaps in reading achievement (see Arnold, 1992; Grey, Peng, 
Steward, & Thomas, 2004; Legewie & DiPrete, 2012; Machin & McNally, 2005). Studies thus far have not 
shown a consistent link between school characteristics and gender achievement gaps. Ma (2008) revealed that 
school-level variables affecting within-school gender difference in reading vary across countries. In particular, he 
found that no school-level variables of PISA 2000 were associated with reading gender gap variation in Albania. 
However, it is still unclear whether there are schools where the achievement gap between girls and boys is higher 
or lower. 

The main objective of this study is to explore achievement, its socioeconomic distribution, and gender gap as 
functions of school characteristics. This study seeks to provide answers to both excellence (high achievement) 
and equity (achievement not related to gender and SES) in education. For this purpose, PISA offers a great 
opportunity to look at how student- and school-level factors affect the quality and equity of educational 
outcomes (OECD, 2010b). This is accomplished through a school effects study that, as defined by Bidwell and 
Kasarda (1980), aims “to assess contributions to students’ achievements made by school inputs distributed to 
these students” (p. 425). Following Raudenbush and Willms (1995), for the purpose of this research, a school 
effect is defined as, “the extent to which attending a particular school modifies a student’s outcome” (p. 308). 
This study employs hierarchical linear modeling (HLM) as a more appropriate method for analyzing data on 
students nested within schools (see Arnold, 1992; Raudenbush & Bryk, 2002; Raudenbush & Willms, 1995; 
Woltman, Feldstain, MacKay, & Rocchi, 2012). It addresses four successive research questions as following. 

Research Question 1: How much do the strength of SES-reading achievement relationship and the gender gap in 
reading achievement vary among schools? 

Research Question 2: Which school-level characteristics are the most significant predictors of average student 
reading achievement at the school level? 

Research Question 3: What school-level characteristics are associated with a smaller or larger gap in reading 
performance between boys and girls? 

Research Question 4: What school-level characteristics are associated with the effect of SES on reading 
achievement? 


29 




www.ccsenet.org/ies 


International Education Studies 


Vol. 7, No. 11; 2014 


2. Method 

2.1 Sample and Data 

I conducted the present study using Albania datasets provided by PISA 2009. As described in OECD (2012), 
PISA was an age-based survey assessing 15-year-old students who attend educational institutions in grade 7 or 
higher. PISA 2009 assessed 4596 students in 181 schools out of 4831 sampled students in 182 sampled schools. 
The sample represented 34 134 students and 1385 schools covering 80% of the student target population. 
According to PISA sampling procedures (OECD, 2012), the sample in Albania was designed as a two-stage 
stratified sample. In the first step, schools were systematically selected using probabilities proportional to their 
size. In the second step, a maximum of 35 students for selected schools were sampled with equal probability. 
PISA data contains a series of design weights, specifically student weights and school weights. I used both 
weights to analyze data and generalize results of this study for the entire population of 15-year-old students and 
schools they attend in Albania. 

2.2 Measures 

2.2.1 Dependent Variable 

The outcome variable of this study is student performance in reading. PISA measures student performance on a 
reading scale that provides an overall assessment of students’ acquired reading skills, knowledge and 
understanding at age 15 (OECD, 2010c). This variable is in the form of five plausible values for the reading 
achievement of each student. Plausible values are not test scores for individuals, but they are suited to describe 
the performance of population. “They are random numbers drawn from the distribution of scores that could be 
reasonably assigned to each individual” (OECD, 2012, p. 142). In this study, these variables are approximately 
normally distributed with a mean equal to the country mean and a standard deviation equal to 100. The HLM 
statistical methodology used in this study includes an option for averaging plausible values. Thus, HLM software 
estimates its models for each of five plausible values and then averages model estimates across these values. 

2.2.2 Student-Level Variables 

Socio-economic status. Student SES is an index variable in 2009 PISA data set. It is a composite derived from 
three other indices: highest occupational status of parents, highest educational level of parents (in years of 
education according to ISCED), and home possessions (OECD, 2012). It is a factor score from a principal 
component analysis. The reliability of this scale (0.71) is satisfactory. In this analysis, the SES variable was 
transformed to a z-scored one with a mean 0 and standard deviation 1, which is also normally distributed. 

Gender. This is a dummy-coded variable for student’s gender (l=female, 0=male). 49.5% of Albanian students 
who participated in the survey are females. 

Reading engagement. The PISA 2009 student file contains data about three measures: reading enjoyment, 
reading diversity, and reading enjoyment time (OECD, 2012). I used principal component analysis with varimax 
rotation to combine these three measures into a single composite. Only one component with an eigenvalue 
greater than 1 was identified. This index has a reliability of 0.57 and shows how much the student is engaged in 
reading. It is an indicator of the student’s engagement and interest in reading, and motivation to read. Positive 
values indicate a more engaged reader and negative values indicate a less engaged reader. This variable is 
z-scored and has an approximately normal distribution. 

Learning strategies use. The approaches to learning in PISA 2009 consist of three measures: memorization, 
elaboration, and control strategies (OECD, 2012). These variables are provided in PISA student data file. Hence, 
a new construct was derived from a principal component analysis with varimax rotation. Only one component 
with an eigenvalue greater than 1 was identified. The reliability of this new measure is 0.74. Positive values of 
this measure indicate greater use of learning strategies and negative values indicate lower use of learning 
strategies. This variable is z-scored and has an approximately normal distribution. 

Classroom environment. PISA 2009 provides two measures that indicate teacher-student relations and 
disciplinary climate in the classroom as perceived by students (OECD, 2012). By using principal component 
analysis with varimax rotation, I created a new measure that provides information on classroom environment. 
Only one component with an eigenvalue greater than 1 was identified. This index has a reliability of 0.3, which 
is rather low. Positive values of this measure indicate a better classroom environment and negative values 
indicate a poorer classroom environment. This variable is z-scored and has an approximately normal distribution. 

Family structure. I recoded an existing variable to create a dummy-coded variable for family structure. Students 
living with two parents were coded to 1. Other students have a 0 on this variable. Approximately 84.1% of 
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Albanian students who participated in PISA 2009 live with both parents. 

2.2.3 School-Level Variables 

Only school variables included in the final analytic models are described below. A few other variables not 
included in constructed hierarchical models were considered, but they are not presented due to their 
non-significance. The school measures of this study come from two sources: students and schools. I constructed 
some school variables as aggregates of student variables in each school. After I averaged student variables across 
students in each school, then 1 used the z-scores of these aggregates in this analysis. The resulting variables are 
close to normally distributed. These school variables are average socio-economic status, average reading 
engagement, average use of reading strategies, and average classroom environment. School characteristics 
included in the school-level models are school type, school sector, and school location. For the purpose of this 
analysis, I created the following dummy coded variables: school type (l=vocational schools, 0=general schools); 
school sector (l=private schools, 0=public schools); school location (l=schools located in urban areas, 
0=schools located in rural areas). 

2.2.4 Handling Missing Data 

School-level variables in this study had no missing values, whereas the percentage of missing values for 
student-level variables was very low (<5%). Consequently, missing data imputation did not bias the results. 
Missing values were replaced by applying the regression imputation method that uses the mean adjustment with 
dummy variable adjustment (J. Cohen, P. Cohen, West, & Aiken, 2002). 

2.3 Analysis 

2.3.1 Preliminary Analysis 

Initially, I conducted factor analysis in SPSS to create the new measures as described above. Thus, I applied the 
model of principal component analysis by using the procedure of Varimax orthogonal rotation to obtain only the 
components for which the eigenvalue is greater than 1 (Tacq, 1997). Then I conducted univariate analysis to 
explore descriptive statistics of variables included in this study. I also carried out analysis to check two-tail t-test 
mean differences and bivariate Pearson correlation for relationships between two variables. Descriptive statistics 
reported in this study were computed by using both student and school weights provided in PISA 2009 datasets. 
In order to test the mean differences between groups, I utilized the WesVar statistical software that computes 
estimates and their variance estimates from survey data using replication methods (OECD, 2009). 

2.3.2 Multilevel Analysis 

The research questions posed in this study are of a multilevel nature. Therefore, I used a multilevel analysis 
strategy to address these questions. Because of the nested structure of the data (students within schools), I 
utilized the HLM 6 software to create two-level hierarchical linear models. Although the software allows 
weighting data at both levels, only the normalized school weights were included in this HLM analysis 
(Raudenbush, Bryk, Cheong, & Congdon, 2004). In HLM I did not employ a student-level weight because the 
student weights within each sampled school are equal. As Lee (2000) suggests, three steps of a typical HLM 
model were followed in this school-effects study. If readers are interested in more details about the statistical 
theory and methodology of HLM applied in this study, are referred to (Raudenbush & Bryk, 2002; Hox, 2002). 

Fully unconditional model. The first step involves partitioning of the variance in the dependent variable into its 
within-school and between-school components. This model contains no student and school variables. The 
proportion of total variance that lies systematically between schools, called the intraclass correlation (ICC), is 
computed. Hence, ICC is modeled as a function of school characteristics. Lee (2000) suggests that only when the 
ICC is more than trivial (i.e., greater than 10% of the total variance in the outcome), the analyst needs to 
consider multilevel methods. In this step, the reliability estimate of the outcome variable is also reported. 
Reliability is defined as the proportion of total variance around each parameter that is parameter variance 
(Arnold, 1992). 

Within-school model. In the second step, the variability in the outcome variable within schools is modeled as a 
function of student characteristics. In this study, student achievement within each school is modeled as a function 
of five student characteristics: gender, SES, reading engagement, learning strategies use, classroom environment, 
and family structure. The other non-significant predictors are removed from the model. This model derives an 
equation for each school. The regression coefficients (betas in HLM results) estimate the effects of student-level 
variables on achievement. Furthermore, this model allows us to examine whether mean reading achievement 
varies significantly among schools. Similarly, it also reveals whether the effects of student-level predictors vary 
significantly across schools. Recommendations on centering, as discussed by Raudenbush and Bryk (2002) are 
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applied for variables included in the model. Effect sizes besides un-standardized coefficients, as suggested by 
Lee et al. (1997) are reported in HLM results. Reliabilities of slopes are checked whether their values are above 
0.1. Raudenbush et al. (2004) recommend fixing any coefficient that has reliability below 0.1. 

Between school model. In this model, school characteristics are added to each of the school-level models in 
order to explain the variation in each of these parameters. The between school equations contain coefficients 
(gammas in HLM results) that estimate the effects of school-level characteristics on average achievement, 
gender difference in achievement, or the SES differentiating effect across the schools. The coefficients (gammas) 
that are non-significant are removed from the final school-level models. For each of the between-school models 
that predict within-school parameters (intercept, gender slope and SES slope), statistics estimated by HLM 
(reliability, parameter variances-tau, tests if tau is greater than 0, proportion of explained variance) are reported 
in the table of results. Effect sizes are also computed and indicated. Note that school-level continuous variables 
included in the models are centered around the grand mean, whereas the dummy variables are kept un-centered. 

3. Results 

3.1 Descriptive Analysis 

Table 1 displays the average of student-level and school-level variables for schools grouped by location, type, 
and sector. 


Table 1. Characteristics of students and schools* 


School location 

School type 

School administration Total 

Urban-Rural 

General-Vocational 

Public-Private 


Student variables'* 


Sample size 3 

3073 


1523 

4261 

335 

4201 


395 

4596 

Reading achievement" 

404 

** 

349 

387 

** 345 

378 

** 

442 

385 

Socio-economic status b 

0.29 

** 

-0.50 

0.00 

-0.03 

-0.09 

** 

0.72 

0.00 

Learning strategies use b 

0.01 


-0.02 

0.00 

* -0.08 

-0.02 

** 

0.14 

0.00 

Reading engagement* 5 

0.04 

+ 

-0.07 

0.00 

-0.11 

-0.02 

** 

0.16 

0.00 

Classroom environment* 5 

-0.05 

** 

0.09 

0.01 

** -0.22 

-0.04 

* 

0.36 

0.00 

Female % 

48.5 


49.1 

50.1 

26.7 

49 


46.7 

48.7 

Two-parent family % 

School variables 6 

88.8 


89.6 

89.5 

81.4 

89.0 


89.1 

89.0 

Sample size 3 

103 


78 

169 

12 

164 


17 

181 

Average socio-economic status* 5 

0.88 

** 

-0.58 

-0.01 

0.40 

-0.24 

** 

1.47 

0.00 

Average classroom environment* 5 

-0.17 

+ 

0.11 

0.02 

-0.48 

-0.08 

** 

0.52 

0.00 

Average reading engagement* 5 

0.19 

* 

-0.13 

0.00 

-0.08 

-0.08 

** 

0.51 

0.00 

Average learning strategies* 5 

0.07 


-0.04 

0.00 

-0.07 

-0.06 

* 

0.38 

0.00 


+ p<0.1; *p<0.05; **p<0.01. 

a Sample sizes are computed unweighted. 

b Continuous variable as a z-score (M=0, SD=1). 

c Reading achievement is represented by five plausible values. 

d Group means are computed using student weight with Wesvar software. 

"Group means are computed using school weight with one-way ANOVA. 

* Three contrasts are tested (urban versus rural, general versus vocational and public versus private). 

Group mean differences in reading achievement indicate that there are significant differences between students 
in urban schools and those in rural schools; between students attending general schools and those attending 
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vocational schools; and between students of private schools and those of public schools. These figures suggest 
that there is a high disparity in achievement across schools, which needs to be explained. Both student SES and 
school average SES are statistically different between groups by school location and school sector, but they are 
not statistically different between groups by school type. Moreover, students that attend urban schools are 
statistically more engaged in reading than students in rural schools; and students in private schools are 
statistically more engaged in reading than students in public schools. Surprisingly, students in rural schools 
report, on average, a better classroom environment than students in urban schools. The index of classroom 
environment is significantly higher for general schools versus vocational schools, and for private schools versus 
public schools. With regards to the index of learning strategies, there is no significant difference between 
students in urban and rural schools. However, there is a significant difference between group means by school 
type and school sector in favor of general schools and private ones respectively. In general, there is a similar 
pattern in the group mean differences at both levels for all variables. I emphasize here that due to the small 
number of vocational schools, there is no significant difference between group means for variables at school 
level. Correlation analysis indicated that there is no evidence of strong relationships between student-level 
variables. Furthermore, I found that there is a large difference between girls and boys in favor of girls not only in 
reading achievement but also in reading engagement and learning strategies use. 

3.2 Multilevel Analysis 

Fully unconditional model. Table 2 contains information that corresponds to the first step of HLM analysis. I 
highlight here two statistics that are important for the next steps. First, the reliability of the outcome variable, 
estimated at 0.92 with HLM, is high. Second, the computed ICC of 0.3 means that about a third of the total 
variance in reading achievement occurs between schools. Although it is lower than the average of OECD 
countries’ ICC values estimated at 0.39 (OECD, 2010b), it is relatively high. The relatively high ICC, associated 
with high reliability, suggests that research for school effects is effectual and fruitful (Lee et al., 1997). 


Table 2. HLM fully unconditional model (n=4596 students in 181 schools) 3 


Outcome variable: 15-year-old 
students’ performance in reading* 5 

Average achievement 

368.88 

Within-school variance (sigma-squared) c 

6979.72 

Between-school variance (tau) 

2969.28 

Between-school standard deviation 5 ' 

54.49 

HLM reliability (Lambda) 

0.92 

Intraclass correlation (ICC) 6 

0.30 

Adjusted intraclass correlation* 

0.32 


“Unweighted sample sizes. 

b Student performance is represented by five plausible values. 

5 This is a variance pooled across schools. 
d This is square root of tau. 

e ICC represents the proportion of total variance in student performance that is systematically found between 
schools. It is computed by formula: ICC=Tau/(Tau+Sigma squared). 

* It is computed by formula: ICC=Tau/(Tau+Lambda*Sigma squared). 


Within-school model. The results of this model in Table 3 are related to the first research question and are 
obtained according to the second step of multilevel analysis procedure described above. In this model, I included 
three demographic variables (SES, gender, and family structure) and two individual behavior variables (reading 
engagement and learning strategies). Beta coefficients indicate that these five student variables are significant 
predictors (p<0.001) of student achievement. Because SES and gender are the variables of interest, the other 
three variables are used as statistical controls. Hence, reading engagement, learning strategies and family 
structure are fixed and grand-mean centered, whereas gender and SES are left free and school-mean centered. 
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Chi-squared values in the table of random effects indicate that school average reading achievement (intercept) 
and the effects of SES and gender on student achievement within schools (slopes) vary significantly between 
schools (p<0.001). I note also that the reliability values of these parameters are acceptable. The SES effect is 
moderate, whereas the gender gap in reading performance between boys and girls within schools is large, even 
after controlling for other variables. Students from low-SES families perform lower than students from high-SES 
families and girls perform much better than boys, while the other student characteristics are held constant. 
Finally, results suggest that about 22.2% of the total pooled within-school variability in the outcome is explained 
by this model (Sigma-squared is 5428.9), compared to the fully unconditional model. 


Table 3. HLM within-school model on 15-year-old students’ performance in reading (n=4596 students in 181 
schools) 3 


Fixed effects 

Beta coefficient 

Effect size 0 


Student-level independent variables' 3 

Intercept 

370.95*** 



Socio-economic status 

11.01*** 

0.202 


Gender (female) 

41.02*** 

0.753 


Learning strategies use 

12.89*** 

0.237 


Reading engagement 

8.85*** 

0.162 


Family structure (two-parent family) 

34.02*** 

0.624 


Random effects 

Variance (Tau) 

Degrees of freedom 

Chi-squared d 

Average achievement 

2621.32 

174 

2365.77*** 

SES/Achievement slope 

94.85 

174 

285.83*** 

Gender difference 

371.25 

174 

310.82*** 

Reliability 13 

Estimate 



Average achievement 

0.933 



SES/Achievement slope 

0.272 



Gender difference 

0.355 




*** pO.OOl. 

a Sample sizes are reported unweighted. Parameters on this table are estimated with a two-level HLM using 
normalized school weights. 

b Gender and socio-economic status are group-mean-centered variables. Learning strategies, reading engagement, 
family structure are grand-mean-centered variables. 

c Effeet sizes are manually computed by dividing the corresponding beta coefficient with the between-school 
standard deviation of the dependent variable estimated in the fully unconditional model. 

d These statistics are based on only 174 of 181 schools that have sufficient data for computation. 


Between-school model. The results of this model are displayed in Table 4. The information in this table is 
relevant to the research questions 2, 3 and 4. As described in step three of multilevel analysis procedure, average 
achievement, gender slope, and SES slope are simultaneously modeled as functions of school characteristics. 
Consequently, three models at school-level are obtained, which explain respectively 43.3%, 7.3%, and 8.2% of 
the total variance. The percentage of total variance explained is “parameter variance explained” times the 
reliability (Arnold, 1992). Only significant effects are presented in the constructed models. The results are 
reported as beta coefficients and in effects size units. Comparing the results of within-school models between the 
two tables reveals that there is a very little change in the magnitude of effects of student variables used as 
statistical controls. Moreover, the reliability estimates of random effects have not significantly changed. 
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Table 4. HLM between-school model on 15-year-old students’ performance in reading (n=4596 students in 181 
schools) 2 


Fixed effects 

A. Outcomes 



Average achievement 

379.03*** 


Average SES/achievement slope 

Average gender difference 

6.6 

-2.76 + 


Average achievement SES/Achievement slope 

Gender difference 


Gamma Effect size b Gamma Effect size b 

Gamma Effect size b 


B. Within-School Model (betas) c 


Socio-economic status 

Gender (female) 

Learning strategies use 

Reading engagement 

Family structure (two-parent family) 

6.6 

-2.76 + 

12.61*** 

32 97 *** 

0.129 

-0.054 

0.246 

0.160 

0.644 





C. Between-School Model (gammas) d 







Average socio-economic status 

36.36*** 

0.710 





Average classroom environment 

7.63 + 

0.149 





Average reading engagement 



7.91+ 

0.812 

8.65 + 

0.449 

School location (urban/rural) 



11.28* 

1.158 

15.83 + 

0.822 

School type (vocational/general) 

-29.05 + 

0.567 

-20.68* 

-2.123 



School sector (public/private) 





42.07*** 

2.183 

Random effects 







Between school variance (Tau) 

1330.66 


43.21 


280.37 


Degrees of freedom 

171 


171 


171 


Chi-squared c 

1268.48 


261.40 


274.83 


Variance percentage explained by model* 

49.2% 


54.4% 


24.5% 


Reliability estimates 6 

0.881 


0.150 


0.297 



+ p<0.1; *p<0.05; **p<0.01; *** p<0.001. 


2 Sample sizes are reported unweighted. Parameters on this table are estimated with a two-level HLM using 
normalized school weights. 

b Effect sizes are computed by dividing HLM gamma coefficients of this model with the between-school standard 
deviation of the outcome estimated in the within-school model. For average achievement, SD=51.2; for the 
SES/achievement slope, SD=9.74; for gender difference, SD=19.27. 

c Gender and socio-economic status are group-mean-centered variables. Learning strategies, reading engagement, 
family structure are grand-mean-centered variables. 

d Average socio-economic status, average classroom environment and average reading engagement are 
country-mean-centered variables. 

e These statistics are based on only 171 of 181 schools that have sufficient data for computation. 

* Percentage of variance explained in reading achievement is computed by comparing the tau in this model to the 
tau in the previous model that is unconditional between schools. Similarly, the percentages of variances 
explained in the SES/achievement and gender slopes are computed by comparing the taus of this model to the 
corresponding slopes taus in the within-school model that does not contain any school variable. 
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School average achievement. I found that two school measures are positively related to reading performance: 
average socio-economic status (school SES) and average classroom environment. The large effect size of school 
SES suggests that students attending advantaged schools tend to score much higher than students attending 
disadvantaged schools. Similarly, students from schools with positive classroom environment achieve higher 
than students from schools with negative classroom environment, even though the effect size is small. 
Furthermore, reading achievement is significantly higher in general schools than in vocational schools. This 
model explains about half of the between-school variance in reading performance. 

SES differentiating effect. The results indicate that this equity parameter is explained by average reading 
engagement, school location, and school type. On average, 54% of the effect of socioeconomic background on 
achievement is accounted for by these factors. Schools with more engaged readers tend to have a higher SES 
effect on reading performance and making them less equitable. Moreover, the figures of Table 4 infer that school 
location and school type influence the equitable distribution of achievement by SES among students in a school. 
Specifically, urban schools and general schools are less equitable. 

Gender difference. On average, gender gap between girls and boys in reading performance is higher in schools 
with more engaged readers. The results suggest that even after controlling for average reading engagement, 
gender difference in achievement is much higher in urban schools than rural ones. Similarly, on average, the 
difference between girls and boys in achievement is considerably higher in private schools compared to public 
schools. The variation in gender achievement gaps across schools is modeled by school location, school sector, 
and average reading engagement. However, the explained variance in gender/achievement slope is relatively low 
(25%). 

4. Discussion 

There is broad agreement that good schools are those that have simultaneously high average achievement and an 
equitable distribution of achievement among students of different backgrounds. Identifying the characteristics 
associated with good schools in Albania was the main purpose of this research. This study focused in academic 
outcomes in terms of effectiveness (i.e., average achievement in reading) and equity (i.e., SES differentiating 
effect and gender difference). It contributes to our understanding of various features and factors that characterize 
a good school in Albania. To my knowledge, it is the first study that demonstrates the relationship of school 
characteristics with students’ achievement in reading and achievement distribution by SES and gender, adjusted 
for several individual characteristics. The study also provides a theoretical framework that identifies significant 
relationships between newly developed constructs and achievement. 

Initially, I explored sources of within-school inequality in reading achievement by considering student SES, 
gender, reading engagement, learning strategies use, and family structure. According to PISA 2009 results, two 
student measures, SES and gender, are significantly related to reading achievement. Specifically, there is a 
medium positive relationship (0.33) between student SES and PISA reading achievement (OECD, 2010a); and 
there is a large gap between girls and boys (62 points) in PISA reading achievement (OECD, 2010c). In this 
paper, I further found that these significant relationships still remain even after accounting for other student 
variables included in this study (reading engagement, learning strategies use, family structure). Moreover, the 
HLM analysis revealed that the effects of both SES and gender on reading achievement vary significantly among 
schools. 

Another feature of my analysis was to find combinations of school characteristics that produce higher average 
achievement in reading. The results of modeling the effectiveness parameter revealed the characteristics of 
schools that relate to school performance. In sum, two indirect measures (average SES and classroom 
environment) and a demographic feature (school type) predict student achievement. They explain a substantial 
proportion of the between-school variation in achievement. More specifically, three conclusions are drawn from 
these results. First, schools with higher mean SES get higher average performance in reading. Consequently, we 
might conclude that being in a school with high SES students increases the chance for a student to get better 
results. Second, schools with higher classroom environment indices have, on average, higher achievement in 
reading. This implies that a student attending a school with a better classroom environment tends to achieve 
higher in reading. I believe that this conclusion provides a good indicator for policy makers. Taking measures to 
create a better classroom environment might increase students’ learning outcomes. Third, general schools in 
Albania seem to have significantly higher achievement than vocational schools, even after controlling for school 
SES and classroom environment. This indicates that typically high-achieving students in Albania choose to 
attend general schools. However, this is not a surprise in Albania because it is known that students who do not 
like to go to the university usually attend vocational schools. It is important to note here that when controlling 
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for other variables, school sector and school location are no longer significant predictors of school performance. 
The finding that the effect of school sector vanishes after controlling for other school variables is congruent with 
results from previous research (e.g., Lee, Franco, & Albernaz, 2004). 

Gender gaps and SES differences in student achievement are two important issues of educational equity. 
Through HLM analysis, this paper investigated the importance of several school characteristics on the effects of 
gender and SES on achievement. The predictors of SES effect are school reading engagement, school type, and 
school location. The predictors of gender effect are school reading engagement, school location, and school 
sector. Average reading engagement in a school seems to influence both effects. The analysis indicated that the 
SES/performance relationship is positively stronger in schools with higher mean reading engagement. Similarly, 
the gender gap in reading achievement is larger for schools with higher mean reading engagement. In terms of 
policy usefulness, this is not desirable because schools with more engaged students in reading are less equitable. 
It is not surprising because if a school has more engaged students in reading, it is likely the school has more 
high-achieving students. Consequently, a question that arises for policy makers from these conclusions is what 
can be done to make low-achieving students being more engaged in reading. With respect to school location, this 
study concludes that SES has less of a differentiating effect in rural schools. That is, rural schools are more 
equitable in distribution of achievement by SES. In addition, gender difference in reading achievement is much 
higher in urban schools than rural ones. School type is one of the school characteristics found to be related to 
SES effect but not gender effect on student achievement. Thus, achievement by SES is distributed more 
equitably in vocational schools than general schools. Moreover, there is strong evidence that school sector is 
related to gender difference in achievement but not SES effect. This study suggests that gender difference in 
achievement is considerably higher in public schools than private schools. It might be very useful for 
policy-makers to recognize the practices of private schools that make them not only more effective but also more 
equitable. 

In summary, it seems that the Albanian educational system is neither effective nor equitable in terms of student 
achievement in reading. The findings of this study shed light into how the student achievement can be improved 
by changing student and school factors that are modifiable. For instance, in reality, we might not control and 
change the SES to improve achievement, but we can change the factors that influence the effect of SES on 
reading performance. As Montt (2010) writes, “by reducing the strength of the relationship between 
socioeconomic status and achievement in a school system, the overall distribution of achievement is also 
equalized” (p. 62). Moreover, Willms (2006) recommends that a mix of interventions will be optimal to achieve 
both excellence and equity because a combination of factors can jointly maximize these parameters. 

However, the results should be cautiously interpreted due to some limitations of this study. First, because this 
study is correlational, the findings cannot be interpreted as causal claims. Second, PISA is a cross sectional study 
and does not measure students’ prior achievement. Therefore, the strength of impact that school characteristics 
can have on student learning (achievement gains) cannot be observed. Third, the findings are valid only for 
15-year old students and cannot be generalized for all students. Fourth, PISA does not collect information about 
teachers, and some school variables are not directly measured. This signals that this study cannot shed light on 
other school characteristics that might potentially be associated with student achievement. Consequently, there is 
a need for more comprehensive surveys to investigate whether pre-university schools in Albania play a 
significant role in raising students’ achievement and closing achievement gaps among various groups of students. 
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